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Introduction 


I.     Introduction 

A.  Objective 

The  primary  objective  of  Operation  2  -  Economic  Coding  is  to  convert  the  written 
responses  for  Questions  37,  38,  39  and  40  into  Industry  and  Occupation  codes. 
Codes  will  be  obtained  using  the  On-line  Reference  Manual  System  (ORMS)  which 
is  an  electronic  version  of  Industry  and  Occupation  reference  material  developed  for 
the  1 996  Census.   The  Census  Automated  Control  System  (CACS)  will  be  used  to 
perform  specific  functions  related  to  Quality  Control  such  as  sampling  and  to 
determine  the  review  status  for  each  EA. 

B.  Work  Flow 

Economic  Coding  consists  of  four  sub-operations:  sub-operation  2A  -  Noting,  sub- 
operation  2B  -  General  Coding,  sub-operation  2C  -  Adjudication,  and  sub-operation 
2D  -  Referral  Coding.   Diagram  1 .1  on  page  2  illustrates  the  work  flow  in  Economic 
Coding.    In  Economic  Coding,  Quality  Control  consists  of  the  Noting  and 
Adjudication  sub-operations.  Three  forms  will  be  used  to  complete  the  duties  in  the 
Quality  Control  sub-operations.   The  Noting  Form,  the  Error  Listing  Form  and  the 
Referral  Form  will  all  be  used  in  sub-operation  2C  -  Adjudication;  the  Noting  Form 
will  be  used  in  sub-operation  2A  -  Noting.   A  copy  of  each  of  these  forms  is 
provided  in  Appendices  A,  B  and  C  on  pages  31 ,  32  and  33  respectively. 

C.  Sub-operation  2A  -  Noting 

Noting  constitutes  the  first  phase  of  quality  control  for  Economic  Coding.  At  the 
Receipt  and  Registration  stage  in  Operation  1 ,  the  sample  of  Form  2B/2C/2D  and 
Form  3  Usual  Resident  (UR)  questionnaires  to  be  noted  for  each  enumeration  area 
(EA)  will  be  selected.  In  sub-operation  2A,  the  Noter  follows  the  General  Coding 
procedures  to  determine  the  appropriate  Industry  and  Occupation  codes  and  records 
them  on  the  Noting  Form.  The  completed  Noting  Forms  are  then  filed  to  be  used 
during  the  adjudication  phase. 

D.  Sub-operation  2C  -  Adjudication 

Adjudication  is  the  second  phase  of  quality  control  for  Economic  Coding.    In 
Adjudication,  the  coding  actions  taken  by  the  Noter  on  the  Noting  Forms  are 
compared  to  the  coding  actions  taken  by  the  General  Coder  for  each  sampled 
questionnaire  within  the  EA  box.   If  the  Adjudicator  finds  discrepancies  between  the 
Noter's  and  the  Coder's  coding  actions,  the  discrepancies  are  recorded  on  the  Error 
Listing  Form  and  the  correct  coding  actions  are  determined  by  following  the  General 
Coding  procedures.   An  error  may  be  charged  to  either  the  Noter  or  Coder  or  both. 
The  Adjudicator  then  counts  all  the  Noter  and  Coder  errors,  and  enters  the  total 
number  of  codes  in  the  sample  and  the  total  number  of  Noter  and  Coder  errors  for 
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Diagram  1.1       Economic  Coding  Work  Flow 
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Industry  and  Occupation  into  the  Census  Automated  Control  System  (CACS)  and  on 
the  Error  Listing  Form.   Based  on  the  total  number  of  codes  in  the  sample  and  the 
total  coder  errors,  the  CACS  will  derive  a  review  status  of  either  accepted  or 
rejected. 

E.   Use  of  Census  Automated  Control  System  (CACS) 

In  1996  the  Census  Automated  Control  System  (CACS)  will  be  used  to 
electronically  control  and  monitor  the  movement  of  EA  boxes  through  Regional 
Processing  operations.   The  CACS  will  make  use  of  barcoding  technology  as  a  main 
input  to  the  system.   The  main  functions  of  the  system  are: 

•  scanning  EA  boxes  IN  to  an  operation/sub-operation  (an  EA  box  will  be  assumed 
scanned  OUT  of  the  previous  operation/sub-operation  when  scanned  IN  to  the 

next); 

•  scanning  who  is  working  on  an  EA  for  Economic  Coding  Quality  Control  and 

productivity  purposes; 

•  input  of  various  information  pertinent  to  an  EA  for  management  and  quality 
control  information  purposes;  and 

•  generating  Noting  forms  with  preprinted  information. 

The  CACS  will  be  used  to  determine  the  Quality  Control  sample  which  consists  of  a 
subset  of  Form  2B/2C/2D  and  Form  3  (UR)  questionnaires  per  EA.   For  each  EA, 
once  the  quality  control  review  is  completed,  the  CACS  will  derive  a  review  status 
based  on  the  total  number  of  codes  in  the  sample  and  the  total  coder  errors  (both 
are  a  combined  count  for  Industry  and  Occupation  among  all  form  types).  The 
CACS  will  indicate  whether  the  coding  quality  of  the  EA  is  acceptable  or  not.   There 
will  be  at  most  two  quality  control  reviews  for  each  EA.   If  the  coding  quality  is 
acceptable,  the  CACS  will  indicate  that  the  EA  is  accepted.    If  the  coding  quality  is 
not  acceptable,  the  CACS  will  indicate  that  the  EA  is  rejected.    If  the  Quality 
Control  sample  is  null  (i.e.,  no  one  to  code  in  the  sample  questionnaires),  the 
internal  CACS  EA  status  will  be  neutral  but  will  be  displayed  as  acceptable. 
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II.    Noter  Duties 

The  following  flow  chart  outlines  the  activities  to  be  performed  by  a  noter  in  sub-operation 
2A  -  Noting. 
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A.  Noting 

In  the  Noting  sub-operation,  responses  to  questions  37  to  40  are  converted  into  numeric 
codes  for  Industry  and  alphanumeric  codes  for  Occupation  for  a  sample  of  the 
questionnaires  in  the  EA.   The  codes  must  be  written  on  the  Noting  Form,  not  on  the 
questionnaire. 

B.  Receipt  of  EA  Box 

1 .  In  Noting,  you  will  receive  an  EA  box  from  your  coordinator. 

2.  Remove  the  sample  questionnaires  and  Noting  Forms  from  the  EA  box.   Ensure  that  the 
number  of  questionnaires  sampled  and  the  number  of  Noting  Forms  printed  are  the 
same  as  the  "Total  Forms  2  and  3  sampled  for  EA"  printed  on  each  Noting  Form.    See 
Diagram  2.1  on  page  6.   If  the  numbers  do  not  correspond,  consult  your  coordinator. 

3.  Ensure  that  the  PROV,  FED,  EA,  VN,  household  number  and  questionnaire  number  on 
each  questionnaire  to  be  noted  are  the  same  as  the  numbers  on  the  corresponding 
Noting  Forms.   If  the  numbers  do  not  correspond,  consult  your  coordinator.   See 
Diagram  2.1  on  page  6. 

4.  Enter  your  Noter  number  and  the  current  date  (YYYY/MM/DD)  in  the  appropriate  boxes 
on  the  Noting  Forms.   See  Diagram  2.1  on  page  6. 

C.  Noting  Procedures 

1 .   For  each  respondent  on  the  questionnaire,  determine  the  correct  actions  to  be  taken  for 
Questions  38  and  40  by  following  the  procedures  in  the  Economic  Coding  Procedures 
Manual  (M-200). 


Note:  This  includes  specific  codes  for  retired  persons,  full  time  homemakers  and 
volunteer  workers  as  specified  in  the  identification  of  whom  to  code 
procedures.  


(a)  Enter  each  code  in  the  appropriate  box  on  the  Noting  Form.   See  Diagram  2.2  on 
page  8. 


a 


-Quality  Control  Procedure  Manual 


Diagram  2.2 

Census  Questionnaire 


REMEMBER,  THESE  QUESTIONS  ARE  ONLY  FOR  PERSONS  AGED  15  AND  OVER 


Note: 


Questions  37  to  44  refer  to  this  person  "s  job  or  business 
last  week.  If  this  person  held  no  job  last  week,  answer 
for  the  job  of  longest  duration  since  January  1, 1995.  If 
this  person  held  more  than  one  job  last  week,  answer  for 
the  job  at  which  he/she  worked  the  most  hours, 

37.  For  whom  did  this  person  work? 


38.  What  kind  of  business,  industry  or  service  was  this? 

Give  full  description.  For  example,  wheat  farm, 
trapping,  road  maintenance,  retail  shoe  store, 
secondary  school,  temporary  help  agency, 
municipal  police. 


HE) 


Name  of  dim,  govammanl 
agency,  ate. 


tiiaW? 


<\ i 


SVMVf 


39.  What  kind  of  work  was  this  person  doing? 

For  example,  janitor,  medical  lab  technician, 
accounting  clerk,  manager  of  civil  engineering 
department,  secondary  school  teacher, 
supervisor  of  data  entry  unit,  fishing  guide. 
(If  in  the  Armed  Forces,  give  rank.) 

Kind  of  work 

05 

W^-wcrt^  «mr. 

U> 

40.  In  this  work,  what  were  this  person's  most 
important  duties  or  activities? 

For  example,  cleaning  buildings,  analysing  blood 
samples,  verifying  invoices,  coordinating  civil 
engineering  projects,  teaching  mathematics, 
organizing  work  schedules  and  monitoring  data 
entry  systems,  guiding  fishing  parties. 

Most  important  duties  or  acthritin 

^V*v\lr%  r. 

uA  J 

06 

1 1  1 1 

Noting  Form 


Person  Number 
Numero  de  personne 

Q.  38 

Industry 
Industrie 

Q.40 

Occupation 
Profession 

Person  1 
•   Personne  1 

S' 

^ 

\ 

G 

9 

i 

I 

- 

Q 


Noter  Duties 


(b)  Be  careful  that  the  person  number  of  the  respondent  is  the  same  on  both  the 
questionnaire  and  the  Noting  Form.   A  person  number  on  the  Noting  Form 
may  be  skipped  if: 

-  a  respondent  skipped  a  person  number  when  completing  the  questionnaire; 

-  a  decision  to  not  code  the. respondent  is  made  as  a  result  of  applying  the 
identification  of  whom  to  code  procedures. 

(c)  If  the  instructions  in  the  coding  manual  tell  you  to  refer  a  written  response  or 
you  cannot  determine  a  code,  put  an  "R"  for  Referral  below  the  coding  boxes 
for  the  question  on  the  Noting  Form.   See  Diagram  2.3  on  page  10.   Do  not 
fill  out  a  Referral  Form  or  affix  a  Referral  label  to  the  EA  box. 

When  you  have  completed  noting  a  questionnaire,  proceed  to  the  next  Noting 
Form  and  questionnaire  in  the  sample  and  repeat  Part  C  -  Noting  Procedures  on 
page  7.   Once  noting  is  completed,  proceed  to  Part  D  -  Forwarding  the  EA  Box 
below. 


Note:  You  MUST  NOT  complete  the  "Total  Industry  codes  in  questionnaire"  and  "Total 
Occupation  codes  in  questionnaire"  boxes  at  the  bottom  of  the  Noting  Form. 
These  boxes  will  be  completed  by  the  Adjudicator. 


D.  Forwarding  the  EA  Box 

When  all  Form  2B/2C/2D  and  Form  3  (UR)  sample  questionnaires  have  been  noted: 

1 .  Return  the  questionnaires  to  the  EA  box  in  the  correct  household  number 
sequence.   For  multi-document  households,  the  questionnaires  must  also  be 
arranged  by  questionnaire  number. 

Note:    For  artificial  EAs  which  contain  late  or  2C  questionnaires,  the 

questionnaires  should  first  be  ordered  by  real  EA  number  (which  identifies 
the  geographic  area)  and  then  by  the  assigned  household  number  and 
questionnaire  number  of  each  EA. 

2.  Arrange  the  Noting  Forms  in  sequence  by  preprinted  "Questionnaire  to  be 
sampled"  number,  separately  for  Forms  2  and  Forms  3. 

3.  Place  the  Noting  Forms  together  inside  the  appropriate  PEDEA  file  in  the  filing 
cabinet. 

4.  Return  the  EA  box  to  your  coordinator. 
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Ml.  Adjudicator  Duties 

The  following  flowchart  highlights  the  activities  to  be  performed  by  an  adjudicator  in 
sub-operation  2C  -  Adjudication. 
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Adjudicator  Duties 


A.  Receipt  of  EA  box 

1 .  You  will  receive  an  EA  box  from  your  coordinator. 

2.  Retrieve  the  completed  Noting  Forms  for  the  EA  from  the  file  in  the  filing 
cabinet.   If  this  is  the  second  review  for  the  EA,  also  retrieve  the  completed 
Error  Listing  Forms  from  the  first  review  from  the  file  in  the  filing  cabinet. 

3.  Check  that  the  PROV,  FED,  EA,  and  VN  numbers  on  the  Noting  Forms  are 
the  same  as  those  on  the  EA  box.    If  they  are  not,  consult  your  coordinator. 

B.  Completion  of  Error  Listing  Form 

The  following  information  should  be  entered  on  the  top  portion  of  a  blank  Error 
Listing  Form.    Refer  to  the  Error  Listing  Form  in  Diagram  3.1  on  page  12. 

1 .  PROV/FED/EA  (PEDEA)  and  VN  numbers  as  recorded  on  the  Noting  Forms 

2.  Noter  number  as  recorded  on  the  Noting  Forms 

3.  Date  noted  (MM/DD)  as  recorded  on  the  Noting  Forms 

4.  Coder  number  as  recorded  on  the  CACS  screen 

5.  Date  coded  (MM/DD)  as  recorded  on  the  CACS  screen 

6.  Review  number  as  recorded  on  the  CACS  screen 

7.  Your  Adjudicator  number 

8.  Date  adjudicated  (MM/DD) 

9.  Sample  type  (enter  an  "X"  in  the  100%  sample  box  if  the  "100%  sample" 
box  on  the  Noting  Forms  contains  a  preprinted  "X"). 


Note:       To  correctly  complete  the  "Page of/de "  on  the  Error  Listing  Forms, 

complete  the  first  blank  of  the  "Page of/de "  on  each  Error  Listing  Form 

as  it  is  being  used.    Once  the  total  number  of  Error  Listing  Forms  used  for  the 
review  has  been  determined,  complete  the  second  blank  of  the  "Page         of/de 


For  every  coding  action,  the  following  information  must  be  entered  on  the  Error 
Listing  Form.    Refer  to  Diagram  3.1  on  page  12. 

10.  Document  type  (2  or  3  as  indicated  in  the  pre-printed  field  on  the  Noting 
Form) 

1 1 .  Household  number 

12.  Questionnaire  number  (i.e.  1  or  2  or  3,  etc.) 

13.  Person  number 
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Diagram  3.2    Noting  Form 
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Diagram  3.3    Census  Questionnaire 


lOVER 


Note: 

Questions  37  to  44  refer  fo  this  person's  job  or  business 
last  week.  If  this  person  held  no  job  last  week,  answer 
tor  the  job  of  longest  duration  since  January  1,  1995.  If 
tin's  person  held  more  than  one  job  last  wee*,  answer  for 
Vie  job  at  which  h&she  wonted  the  most  hours, 

37.  For  whom  did  this  person  work? 


34.    What  kind  of  business,  industry  or  service  was  Ihis? 

Give  full  description.  For  example,  wheat  farm, 
trapping,  road  maintenance,  retail  shoe  store, 
secondary  school,  temporary  help  agency, 
municipal  police. 


39.   What  kind  of  work  was  this  person  doing? 

For  example,  janitor,  medical  lab  technician, 
accounting  clerY,  manager  of  civil  engineering 
department,  secondary  school  teacher, 
supervisor  of  data  entry  unit,  fishing  guide. 
(If  in  the  Armed  Forces,  gtve  rank.) 


40.    In  (his  work,  what  wore  this  person's  most 
important  duties  or  activities? 

For  example,  cleaning  buildings,  analysing  blood 
samples,  verifying  invoices,  coordinating  civil 
engineering  projects,  teaching  mathematics, 
organizing  work  schedules  and  monitoring  data 
entry  systems,  guiding  fishing  parties. 
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Diagram  3.4      Census  Questionnaire 
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Note: 

Qoestfons  37  to  44  refer  fo  this  person's  job  or  business 
last  week.  If  this  person  held  no  job  last  week,  answer 
for  the  job  of  longest  duration  since  January  1.  1995.  If 
this  person  held  mora  than  one  job  last  week,  answer  tor 
the  job  at  which  he/she  worked  the  most  hours. 

37.  For  whom  did  this  person  work? 


38.   What  kind  of  business,  industry  or  service  was  this? 

Give  full  description.  For  example,  wheat  farm, 
trapping,  road  maintenance,  retail  shoe  store, 
secondary  school,  temporary  help  agency, 
municipal  police. 


39.   What  kind  of  work  was  this  person  doing? 

For  example,  janitor,  medical  lab  technician, 
accounting  clerk,  manager  of  civil  engineering 
department,  secondary  school  teacher, 
supervisor  of  data  entry  unit,  fishing  guide, 
(tf  in  the  Armed  Forces,  give  rank.) 


40.   In  (his  work,  what  were  this  person's  most 
important  duties  or  activities? 

For  example,  cleaning  buildings,  analysing  blood 
samples,  verifying  invoices,  coordinating  civil 
engineering  projects,  teaching  mathematics, 
organizing  work  schedules  and  monitoring  data 
entry  systems,  guiding  fishing  parties. 
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Diagram  3.5    Referral  Form 
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Adjudicator  Duties 


14.  Question  being  adjudicated  (either  Industry  or  Occupation,  but  not  both  on  the 
same  line) 

15.  Noter  and  Coder  actions 

16.  Adjudicator  code  (an  "X"  for  an  error  or  a  "J"  for  a  justifiable  code  in  at  least 
one  of  the  Noter  or  Coder  error  columns  for  the  question  being  adjudicated) 

C.  Adjudication 

During  sub-operation  2C  -  Adjudication,  the  Adjudicator  will  compare  the  Noter  and 
Coder  coding  actions  and  determine  the  number  of  errors  made  by  both  in  coding 
the  sampled  questionnaires.  The  Adjudicator  will  also  complete  the  total  Industry 
and  total  Occupation  codes  at  the  bottom  of  the  Noting  Form.   At  the  end  of  the 
review,  the  Adjudicator  will  either  correct  the  Coder's  errors  or  will  forward  the  EA 
to  the  coordinator  for  recoding  by  another  clerk. 

1.    Adjudication  Steps 

Compare  the  work  of  the  Noter  on  the  Noting  Forms  with  the  work  of  the  Coder 
for  Questions  38  and  40  on  the  sampled  questionnaires.   There  will  either  be 
agreement  or  disagreement  between  the  Noter  and  Coder. 

Situation  1  -  Agreement  between  Noter  and  Coder 

Table  3.1  below  represents  the  situations  in  which  there  is  agreement  between 
the  Noter  and  the  Coder. 


Table  3.1  Agreement  between  Noter  and  Coder 


Coder/Noter 
Assessment 

Noter  Action 

Coder  Action 

Both  (alpha)numeric 
codes  are  the  same. 

Code  entered  in  the 
coding  box  on  the 
Noting  Form  (see 
diagram  3.2(a)  on 
page  14). 

Same  code  entered  in  the  coding  block  on 
the  questionnaire  (see  Diagram  3.3  on  page 
14). 

Both  the  Noter  and 
Coder  referred  the 
question. 

"R"  entered  below 
the  coding  block  on 
the  Noting  Form 
(see  Diagram  3.2(b) 
on  page  14). 

The  coding  block  on  the  questionnaire  is 
blank  (see  Diagram  3.4  on  page  14). 

A  Referral  Label  is  attached  to  the  EA  box 
and  the  corresponding  "Document  Type", 
"Household  No.",  "Questionnaire  No.", 
"Person  No.",  and  "Question  No."  are 
recorded  on  a. Referral  Form  (see 
Diagram  3.5(a)  on  page  14).    If  no  Referral 
Label  is  present,  attach  one  to  the  EA  box. 

Both  the  Noter  and 
Coder  took  no 
action. 

The  coding  block  on 
the  Noting  Form  is 
blank  (see  Diagram 
3.2(c)  on  page  14). 

The  coding  block  on  the  questionnaire  is 
blank  (see  Diagram  3.4  on  page  14). 

The  corresponding  question  and  person 
numbers  are  not  recorded  on  the  Referral 
Form  (see  Diagram  3.5(b)  on  page  14). 
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Diagram  3.6 
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Adjudicator  Duties 


Note:    In  cases  where  the  Noter  and  Coder  agree,  it  is  not  usually  necessary  to  enter 

information  on  the  Error  Listing  Form.    It  is  also  not  usually  necessary  to  verify  the 
codes  assigned.    However,  in  cases  of  obvious  coding  error,  the  Coordinator 
should  check  the  code  and,  if  the  coordinator  is  in  agreement  with  the 
Adjudicator,  the  Noter,  Coder  and  Adjudicator  actions  should  be  listed  on  an  Error 
Listing  Form  and  an  error  assigned  to  the  Noter  and  Coder. 


Situation  2  -  Noter  and  Coder  Disagree 

If  the  Noter  and  Coder  coding  actions  are  different,  determine  the  correct  coding 
action  by  using  the  Economic  Coding  Procedures  Manual  (M-200)  and  enter  this 
coding  action  in  the  "Adjudicator  code"  column  of  the  Error  Listing  Form.   See 
Diagram  3.6  on  page  16.   Complete  the  Noter  and  Coder  error  columns  on  the 
Error  Listing  Form  according  to  Table  3.2  -  Adjudicator  Action  When  Noter  and 
Coder  Disagree  below. 

Table  3.2  Adjudicator  Action  When  Noter  and  Coder  Disagree 


Adjudicator  assessment 

Coding  Action 
(by  Noter  or  Coder) 

Adjudicator's  Action  in 

error  column(s) 

corresponding  to  Coding 

Action  (by  Noter  or  Coder) 

Response  should  not  be  coded. 

The  response  is  coded 
or  referred. 

Enter  an  "X"  (see  Diagram 
3.6(a)  on  page  16). 

The  correct  code  for  the 
response  is  A. 

The  code  assigned  is 
not  A  or  the  response 
is  referred  or  the 
response  is  not  coded. 

Enter  an  "X"  (see  Diagram 
3.6(b)  on  page  16). 

The  response  requires  referral. 

The  response  is  not 
referred. 

Enter  an  "X"  (see  Diagram 
3.6(c)  on  page  16). 

More  than  one  code  is  equally 
correct  for  the  response. 

Code  assigned  is  not  in 
the  set  of  equally 
correct  codes  or  the 
response  is  neither 
coded  nor  referred. 

Enter  an  "X"  (see  Diagram 
3.6(d)  on  page  16). 

Code  assigned  is  in  the 
set  of  equally  correct 
codes. 

Enter  a  "J"  (see  Diagram 
3.6(e)  on  page  16). 

The  response  is 
referred. 

Enter  a  "J"  (see  Diagram 
3.6(f)  on  page  16). 
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Total  codes  in  sample 

Total  des  codes  dans  I'echantillon 


Industry 
Industrie 

Occupation 
Profession 

B-4600-84:  199&02-19 


M     Statistics     Statistique 
Canada      Canada 


Canada 


^ 
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2.  Recurring  Errors  among  Noters  and  Coders 

If,  during  the  performance  of  your  adjudication  duties,  you  notice  that  a  Noter  or  Coder 
is  consistently  miscoding  a  particular  response  or  misapplying  the  identification  of 
whom  to  code  procedures,  bring  the  situation  to  the  attention  of  your  coordinator 
immediately.  Your  coordinator  will  inform  the  Noter's  or  Coder's  coordinator  so  that  the 
situation  can  be  corrected. 

3.  Completion  of  Review 

(a)  Once  the  number  of  Error  Listing  Forms  has  been  determined,  complete  the  second 

blank  of  the  "Page of "  on  each  Error  Listing  Form.   For  example:  if  three 

Error  Listing  Forms  were  used,  they  would  be  numbered  Page  1  of  3,  Page  2  of  3 
and  Page  3  of  3.   See  Diagram  3.7  on  page  18. 

(b)  Complete  the  Noter  and  Coder  error  columns  on  each  Error  Listing  Form  as  follows: 

•  Count  the  number  of  Noter  and  Coder  errors  for  Industry  on  the  Error  Listing 
Form  and  enter  each  total  in  the  appropriate  Industry  box  for  "Total  errors  for 
this  page"  on  the  Error  Listing  Form.   See  Diagram  3.7  on  page  18. 

•  Count  the  number  of  Noter  and  Coder  errors  for  Occupation  on  the  Error  Listing 
Form  and  enter  each  total  in  the  appropriate  Occupation  box  for  "Total  errors 
for  this  page"  on  the  Error  Listing  Form.   See  Diagram  3.7  on  page  1 8. 

•  If  this  is  the  first  Error  Listing  Form,  enter  the  four  totals  for  Noter  and  Coder 
Industry  and  Occupation  errors  in  the  "Cumulative  total  errors"  boxes.    See 
Diagram  3.7  on  page  18. 

•  If  more  than  one  Error  Listing  Form  was  used,  complete  the  Noter  and  Coder 
"Cumulative  total  errors"  boxes  for  Industry  and  Occupation  on  each  form  by 
adding  the  "Cumulative  total  errors"  from  the  previous  page  to  the  total  errors 
for  the  current  page. 
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Adjudicator  Duties 


(c)  After  comparing  the  Noter  codes  on  each  Noting  Form  with  the  Coder  codes  on  the 
sampled  questionnaires,  you  must  determine  the  "Total  Industry  codes  in 
questionnaire"  and  "Total  Occupation  codes  in  questionnaire",  and  enter  each  total 
in  the  appropriate  box  on  the  bottom  of  the  Noting  Form.   This  process  must  be 
completed  for  each  review  of  an  EA.   If  the  EA  is  in  second  review,  it  may  be 
necessary  to  modify  these  totals  from  the  first  review  on  one  or  more  Noting  Forms. 
This  number  is  not  obtained  simply  by  adding  the  codes  appearing  on  the  Noting 
Form  as  this  number  may  be  incorrect.   The  following  cases  depict  situations  which 
would  change  the  "Total  Industry  codes  in  questionnaire"  and  "Total  Occupation 
codes  in  questionnaire"  (see  Diagram  3.8  on  page  20): 

(i)   According  to  the  Adjudicator  code  on  the  Error  Listing  Form,  if  one  person  on 
the  questionnaire  should  have  been  coded  but  no  entry  has  been  made  on  the 
Noting  Form  for  that  person,  the  total  codes  for  the  Industry  and  Occupation 
variables  would  be  the  number  of  codes  for  that  variable  on  the  Noting  Form 
plus  1 . 

(ii)   According  to  the  Adjudicator  code  on  the  Error  Listing  Form,  if  one  person  on 
the  questionnaire  should  not  have  been  coded  but  the  Noter  coded  or  referred 
the  question,  the  total  codes  for  the  Industry  and  Occupation  variables  would  be 
the  number  of  codes  for  that  variable  on  the  Noting  Form  minus  1 . 

(iii)   A  combination  of  points  (i)  and  (ii). 

Notice  however  that  if  a  person  on  the  questionnaire  is  coded  as  retired  (001 ), 
housewife  (002)  or  volunteer  (003)  in  the  Industry  boxes,  there  should  be  no 
Occupation  code  for  this  person.    In  these  cases,  the  total  codes  for  Industry  will  be 
higher  than  the  total  codes  for  Occupation. 

(d)  Once  this  is  completed  for  all  Noting  Forms  for  the  EA,  enter  the  sum  of  the  "Total 
Industry  codes  in  questionnaire"  and  "Total  Occupation  codes  in  questionnaire"  into 
the  "Total  codes  in  sample"  box  for  Industry  and  the  "Total  codes  in  sample"  box 
for  Occupation  on  the  last  page  of  the  Error  Listing  Forms.   See  Diagram  3.8  on 
page  20. 
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Adjudicator  Duties 


Acceptance/Rejection  of  EA 

If  the  "Total  codes  in  sample"  for  both  Industry  and  Occupation  are  zero,  refer  to  the 
note  below  on  the  Null  Quality  Control  (QC)  sample. 

If  the  "Total  codes  in.sample"  for  both  Industry  and  Occupation  are  not  zero,  proceed 
to  page  25  to  determine  the  correct  acceptance/rejection  procedure. 


Note: 


It  is  possible  that  for  some  EAs  there  will  be  no  one  to  code  in  the 
sample  questionnaires.  This  situation  is  called  a  null  QC  sample  and  it 
requires  adjudication  procedures  that  differ  slightly  from  those  followed 
for  other  EAs. 


If  it  appears  from  the  Coder  and  Noter  actions  that  the  EA  has  a  null  QC  sample, 
the  Adjudicator  should  recode  the  Quality  Control  sample  questionnaires  and  take 
the  specified  actions,  depending  on  whether  or  not  the  sample  is  truly  null. 

1 .  If  the  sample  is  not  null,  the  Adjudicator  should  proceed  as  per  regular  EAs 
although  there  will  be  some  entries  on  the  Error  Listing  Forms  that  show  the 
Coder  and  Noter  in  agreement  and  in  error.  The  CACS  will  then  derive  the 
review  status  as  usual  ("A"  for  acceptable  quality  or  "U"  for  unacceptable 
quality.) 

2.  If  the  sample  is  null,  the  Adjudicator  recodes  the  non-sample  questionnaires  in 
the  EA  (if  there  are  any).   The  Adjudicator  would  enter  the  following 
information  on  the  Error  Listing  Form. 

•  enter  "0"  for  "Total  noter  errors"  and  "Total  codes  in  sample". 

•  write  "No  one  to  code  in  Quality  Control  sample". 

•  write  "Responses  to  code  in  non-sample  questionnaires"  or  "No  one  to 
code  in  non-sample  questionnaires"  according  to  whether  or  not  any 
responses  to  code  were  found  among  the  non-sample  questionnaires. 

•  fill  out  a  Referral  Form  and  affix  a  Referral  Label  to  the  EA  box  if  a 
write-in  needs  to  be  referred. 

•  checkmark  the  Accepted  box  and  write  "Neutral"  below  it. 

•  in  the  CACS,  enter  a  "0"  for  "Total  noter  errors",  "Total  coder  errors" 
and  "Total  codes  in  sample".  The  CACS  will  generate  an  internal 
review  status  of  "N"  instead  of  "A"  or  "U".   The  EA  is  sent  to  sub- 
operation  2D  -  Referral  Coding  if  there  are  any  referrals.   Otherwise  the 
EA  is  sent  to  Operation  3. 
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Diagram  3.9    Referral  Form 
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Adjudicator  Duties 


Enter  the  Noter  and  Coder  error  counts  for  Industry  and  Occupation  appearing  in  the 
"Cumulative  total  errors"  boxes  on  the  Error  Listing  Form  as  well  as  the  Industry  and 
Occupation  counts  appearing  in  the  "Total  codes  in  sample"  boxes  into  the  CACS. 


(a) 


If  the  EA  is  accepted  under  first  or  second  review: 

(i)   Check  mark  the  "Accepted"  box  on  the  Error  Listing  Form. 

(ii)  Correct  all  of  the  Coder  errors  for  Questions  38  and  40.  Where  there  is  an  "X"  in 
the  "Coder  error"  column  of  the  Error  Listing  Form,  erase  the  code  on  the 
questionnaire  and  assign  your  code  from  the  Error  Listing  Form  to  that  question. 

(iii)  Remove  and  destroy  the  Reject  Label  from  the  side  of  the  EA  box  if  there  is  one 
present. 

(iv)  Place  the  Noting  Forms  and  Error  Listing  Forms  in  an  envelope  and  place  the 
envelope  inside  the  EA  box. 

(v)   If  there  are  existing  (i.e.,  uncancelled)  entries  on  a  Referral  Form  and/or  referrals  by 
the  Adjudicator  on  the  Error  Listing  Form,  follow  the  Referral  Procedures  below. 

(vi)  Proceed  to  Part  D  -  Forwarding  the  EA  Box  on  page  30. 


Note: 


The  Referral  Procedures  below  should  only  be  followed  for 
referrals  in  the  Quality  Control  sample. 


Referral  Procedures 


Situation 

Adjudicator  Action 

Coder:  code  marked  "J" 
Adjudicator:  referral 

Take  no  action.  The  Coder's  code  should  remain  on  the 
questionnaire  and  the  question  should  not  be  referred. 

Coder:  code  or  blank 

marked  "X" 
Adjudicator:  referral 

Refer  the  question  to  sub-operation  2D  -  Referral  Coding. 

Complete  the  appropriate  entries  on  the  Referral  Form.  Write 
your  initials  in  the  left  hand  margin  beside  the  referred 
question.    Place  the  form  in  the  EA  box.    See  Diagram  3.9  on 
page  24. 

Attach  a  Referral  Label  to  the  EA  box  if  one  is  not  attached. 

Coder:  referral 
Adjudicator:  referral 

Take  no  action.   The  question  has  already  been  referred  by 
the  Coder. 

Coder:  referral  marked  "J" 
Adjudicator:  code 

OR 

Coder:  referral  marked  "X" 
Adjudicator:  code  or  blank 

Enter  your  code  for  this  question  on  the  questionnaire. 

Cancel  the  referral  for  this  question  by  drawing  a  line  through 
the  entry  on  the  Referral  Form. 

If  there  are  no  additional  entries  on  the  Referral  Form  for  the 
entire  EA  box,  remove  and  destroy  the  Referral  Label. 

Adjudicator  Duties 


Note:  An  error  must  be  charged  to  a  noter  or  coder  for  both  an  under- 

and  over-referral.   This  does  not  include  cases  where  Noter  or 
Coder  actions  have  been  marked  "J"  in  the  error  column. 


(b)  If  the  sampling  rate  is  100%  and  the  EA  box  is  of  unacceptable  quality  (rejected) 
under  first  review: 

(i)    Mark  the  "Rejected"  box  on  the  Error  Listing  Form.   Do  not  affix  a  Reject  Label 
to  the  side  of  the  EA  box. 

(ii)   Correct  all  Coder  errors  for  Questions  38  and  40  in  the  sampled  questionnaires. 
If  there  is  an  "X"  in  the  "Coder  error"  column  of  the  Error  Listing  Form,  erase 
the  code  on  the  questionnaire  and  assign  the  Adjudicator  code  to  that  question. 

(iii)    Place  the  Noting  Forms  and  Error  Listing  Forms  in  an  envelope  and  place  the 
envelope  inside  the  EA  box. 

(iv)    If  there  are  existing  (i.e.,  uncancelled)  entries  on  a  Referral  Form  and/or  referrals 
by  the  Adjudicator  on  the  Error  Listing  Form,  follow  the  Referral  Procedures  on 
page  25. 

(v)   Proceed  to  Part  D  -  Forwarding  the  EA  Box  on  page  30. 

(c)  If  the  sampling  rate  is  less  than  1 00%  and  the  EA  is  of  unacceptable  quality 
(rejected)  under  first  review: 

(i)    Checkmark  the  "Rejected"  box  on  the  Error  Listing  Form. 

(ii)   Attach  a  Reject  Label  to  the  side  of  the  EA  box. 

(iii)   Put  the  Noting  Forms  and  Error  Listing  Forms  in  the  appropriate  PEDEA  file  in 
the  filing  cabinet. 

(iv)    Replace  the  sampled  questionnaires  in  the  EA  box  by  real  EA  number  and  by  the 
correct  household  number. 

(v)    If  a  Referral  Form  was  used  by  the  Coder,  put  a  large  "X"  over  the  entire 
Referral  Form  and  place  it  in  the  appropriate  PEDEA  file  in  the  filing  cabinet. 
Remove  and  destroy  the  Referral  Label. 

(vi)    Return  the  EA  to  your  coordinator  who  will  forward  the  EA  to  sub-operation  2B 
-  General  Coding. 
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Diagram  3.10     Error  Listing  Form 
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'  Complete  this  section  on  final  page  only,  for  each  EA. 

'  Remplissez  cette  section  sur  la  demiere  page  seulement,  pour  chaque  SD. 


Total  codes  in  sample 

Total  des  codes  dans  I'echantillon 


Adjudicator  Duties 


(d)  If  the  EA  is  of  unacceptable  quality  (rejected)  under  second  review: 

(i)    Checkmark  the  "Rejected"  box  on  the  Error  Listing  Form. 

(ii)    Put  the  Noting  Forms  and  Error  Listing  Forms  in  the  appropriate  PEDEA  file  in 
the  filing  cabinet. 

(iii)    If  a  Referral  Form  was  used  by  the  Coder,  put  a  large  "X"  over  the  entire 
Referral  Form  and  place  it  in  the  appropriate  PEDEA  file  in  the  filing  cabinet. 
Remove  and  destroy  the  Referral  Label. 

(iv)    Forward  the  EA  box  to  your  coordinator  who  will  assign  the  EA  to  another 
Adjudicator  for  recoding. 


Note:     The  third  Adjudicator  must  be  different  from  the  second 
Adjudicator  but  may  be  the  same  as  the  first  Adjudicator. 


(e)  If  the  EA  must  be  recoded  after  being  rejected  in  the  second  review: 

(i)    Recode  all  Form  2B/2C/2D  and  Form  3  (UR)  questionnaires  by  applying  the 
procedures  in  the  Economic  Coding  Procedures  Manual  (M-200).  Whenever 
your  code  disagrees  with  the  code  assigned  by  the  Coder,  erase  completely 
the  Coder's  code  and  enter  your  code. 

(ii)    If  you  determine  that  a  question  should  be  referred: 

(1)  Complete  the  appropriate  entries  on  a  Referral  Form.   For  "Coder  No." 
enter  your  adjudicator  number  on  the  form. 

(2)  Attach  a  Referral  Label  to  the  EA  box. 

(iv)   When  you  have  completed  recoding  all  Form  2B/2C/2D  and  Form  3  (UR) 
questionnaires: 

(1)  Write  "Verified  in  sub-operation  2C"  on  the  Error  Listing  Form  beside  the 
checkmark  in  the  "Rejected"  box.   Also  write  your  Adjudicator  number 
and  the  date.   See  Diagram  3.10  on  page  28. 

(2)  Remove  the  "Reject"  label  from  the  EA  box. 

(3)  Proceed  to  Part  D  -  Forwarding  the  EA  Box  on  page  30. 
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D.  Forwarding  the  EA  Box 

1 .  Place  the  sample  questionnaires  back  in  the  EA  box  by  realEA  number  in  the 
correct  household  number  sequence  and  questionnaire  number  for  multi- 
document  households  with  the  other  Form  2B/2C/2D  and  Form  3  (UR) 
questionnaires. 

2.  Separate  the  Error  Listing  Forms  and  send  the  yellow  copy  to  the  coordinator  of 
the  Coding  Clerk  whose  work  has  just  been  reviewed. 

3.  Place  the  Noting  Forms  and  the  white  copy  of  the  Error  Listing  Form  in  an 
envelope  and  place  it  on  top  of  the  questionnaires  inside  the  EA  box. 

4.  Place  any  Referral  Forms  on  top  of  the  questionnaires  in  the  EA  box. 

5.  Return  the  EA  box  to  your  coordinator. 
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